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Abstract. We develop a max-plus spectral theory for infinite matrices. We 
introduce recurrence and tightness conditions, under which many results of the 
finite dimensional theory, concerning the representation of eigenvectors and 
the asymptotic behavior of powers of matrices, carry over. We also announce 
more general representation results for eigenvectors, which are obtained by 
introducing a max-plus analogue of the Martin boundary. 



1. Introduction 

Given a set S and a map A : 5 x S* ^ KU {— oo}, ^-^ Aij, we consider tiie 
following spectral problem: find A G M U {—00} and w : 5 ^ R U {—00}, i t-^ Ui, 
not identically --00, such that 

X + Ui ~ swp{Aij + Uj) for all i ^ S. 

We say that A is an eigenvalue of A and that u is an eigenvector (or a X- eigenvector). 
This terminology can be justified by introducing the max-plus semiring, which is 
the set Mmax := MU {— 00} equipped with the addition operation a(Bb :— max(a, b) 
and multiplication operation a (S) b := a + b. We write := —00 and 1 := for the 
zero and unit elements of Rmax, respectively, and also denote by (D the identically 
(D vector. 

In max-plus notation, the spectral problem becomes: 

find u G K^a^x \ I'D} such that Aw = Au, 
where A : M^ax ^ (Rmax U {+00})'^ is the operator defined by 
(1) (Au), := A,,uj . 

Here and in the rest of the paper, we adopt the usual algebraic conventions, writing 
for instance ab instead of a Cg) 6. We also use the notation for the supremum of 
an arbitrary family. 
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The operator A is max-plus linear, meaning that A{au © Pv) = aAu © (3Av, 
for all u,v G Kfiax and a,/? G Kmax- A max-plus "Riesz representation theorem", 
due to Kolokoltsov and Maslov jKMSSL |Kol90, KM97j and Akian !Aki99] states 
that under fairly general conditions, max-plus linear maps can be represented in the 
form giv en in ^ ( see also |Plu9 1| . [Shu92| . |Kol92] . |BCOQ92l Th. 6.5], |Sin97l 
Ch. 8], |AGKn4] ). The map ^ Aij is called the kernel or matrix of the 

operator A. 

Max-plus linear operators with kernels arise as dynamic programming oper- 
ators associated to optimal control problems (see for instance |Rom67j l. Here, 
the eigenvectors are the stationary solutions of the dynamic programming equa- 
tions and A is the maximal ergodic reward per time unit. The spectral problem 
also arises in the study of discrete event systems ICDQVS S*, 'BCOQ92J , in sta- 
tistical mechanics |C086| . in perturbation problems for eigenvalues and eigenvec- 
tors |ABG98LlABG04j . and in the study of delay systems |MPN02j . 

The spectral problem has been much studied in the "matrix case", that is 
when 5 is a finite set. A basic result, which was obtained independently by sev- 
eral authors, including Cuninghame-Green |C079| . Romanovskii |R.om67j . and 
Vorob'ev |Vor67| . is that when A is irreducible, it has a unique eigenvalue which 
coincides with the maximal circuit mean of A. Gondran and Minoux |GM77| 
and Cuninghame-Green |CG79[ Th. 24.9] both obtained a generating family of 
the eigenspace. Cohen, Dubois, Quadrat, and Viot |CDQV83| showed that the 
asymptotic behavior of the powers of A can be described expHcitly in terms of the 
eigenvectors. A useful tool in this theory is the critical graph, which consists of 
the circuits with maximal circuit mean. It allows one to determine the dimension 
of the eigenspace and the ultimate period of the powers of A. Other references on 
the subject are |Zim8ll IGM84L ICKR84L [CQD90t INus9lL |BCOQ92t IDS92L 
ICG9RL iRSX^HngRL [GP971 |Bap98t rGMn2f ^ 

The case when S is infinite has also received some attention |Dud92L IKol92L 
ILS92LrYK92llKM97llMPNn2| . particularly the case when S is compact, A leaves 
the space of continuous functions from S to Mmax invariant, and the eigenvector is 
required to be in this space. For instance, in |Kol92[ Th. 2], Kolokoltsov character- 
ized the case where ^ is a compact map. In IKM971 Section 2.3], Kolokoltsov and 
Maslov gave, under some additional assumptions, existence results for the eigen- 
vector, using a Krein-Rutman type fixed point approach. They also described the 
eigenspace and gave convergence results in special cases. Some of the results of 
these two references apply more generally to the case where S is locally compact, 
provided one considers only eigenvectors that tend to (D at infinity. In jMPN02j, 
Mallet-Paret and Nussbaum showed the existence of eigenvectors in the case when 
S' is a compact interval of M and A is a particular non-compact map, using measures 
of non-compactness. 

We should also remark that the continuous time version of the max-plus spectral 
problem appears in the study of the Lagrange problem of calculus of variations and 
of Hamilton-Jacobi equations, see |MS92| . jKM97j Ch. 3], and in the related 
subject of weak KAM-theory |Mat91L IMan97L IFat97L lF^^tT)3] . 

In this paper, we assume that S is an infinite discrete topological space, and 
develop a general max-plus spectral theory in this context. 

Section|2is devoted to preliminaries. In particular, we recall the definition and 
properties of the max-plus analogue of the potential kernel, A* := J © A © © • • • , 
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and of the maximal circuit mean, p{A). A useful observation, made in |Dud92| . is 
that every eigenvalue associated to an eigenvector with full support must be greater 
than or equal to p{A). Unlike in the finite dimensional case, the spectrum of A 
may differ from even when A is irreducible. 

In Sections m to we study the eigenspace associated to the value p{A), ex- 
tending some results from the finite dimensional theory. 

A new feature is the notion of recurrent nodes and classes, which replaces the 
notion of critical nodes and classes appearing in the finite-dimensional theory. A 
node is recurrent (Definition |S3J if one can return to it with "normalized" reward 1. 
In algebraic terms, assuming p{A) £ R and setting A = p{A)~^A and A'^ := AA* , 
we say that a node i is recurrent if Af^ = 1. Associated to any recurrent node i is 
an eigenvector of A, obtained by taking the ith column of A^ (Proposition 15 .111 . 

We then introduce a tightness condition (Property (T), see Definition I4.3|l 
which may be interpreted as saying that trajectories passing near infinity have 
a high cost. When A has Property (T), critical nodes and recurrent nodes coincide 
(Theorem ESI. 

Still assuming that A has Property (T), we show in Section El that each p{A)- 
eigenvector satisfying a certain tightness condition can be represented as an infinite 
max-plus linear combination of the critical columns of A* f Theorem 16. 5|l . This ex- 
tends the previously mentioned theorems of |GM77LICG79L|CDQ V83| describing 
the eigenspace in the finite dimensional case. 

In Section 13 we obtain asymptotic results for the iterates of a matrix having 
Property (T). Theorem 17.41 extends the cyclicity theorem of [CD QV83j for finite 
irreducible matrices. Our result is closely related to a "Turnpike theorem" that we 
state as Theorem 17.51 

The representation theorem of Section El yields only eigenvectors having eigen- 
value p{A), and even for this eigenvalue, it gives no information about eigenvectors 
that do not satisfy the tightness condition. This is related to the fact that the 
optimal trajectory associated to an eigenvector may head off to infinity. In order 
to describe the entire eigenspace, one must develop a boundary theory analogous 
to the Martin boundary theory for Markov chains. We do this in another pa- 
per |AGW04j . In Section IHI of the present paper, we recall the principal results 
without proof, and revisit some of the examples of Sections to in the light of 
max-plus Martin boundaries. 



2. Graphs and potential kernels 

Since the supremum of an infinite set may be infinite, we shall occasionally need 
to consider the completed max-plus semiring K„iax, which is obtained by adjoining 
to Mmax an element -l-oo, with the convention that (D = — oo remains absorbing for 
the semiring multiplication. 

As in the introduction, we use the symbol A to denote both a matrix (or kernel) 

A £ Mmax ^iid the associated max-plus linear operator A : Rf^ax ~^ ^max; ^ Au 
defined by iQJ. We shall also need to consider infinite valued kernels and operators, 

g y ^ g g 

that is kernels A £ R^ax their corresponding operators A : R^^^x ~^ ^mux^ " 
Au. In addition to being max-plus Hnear as defined in the introduction, such 
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operators are infinitely max-additive: 

A(0 u^) = Au'^ for all families {u'^}teL C l^x ■ 

To any matrix A S Kmajf ) associate the digraph G{A) with set of nodes 
S and an arc i ^ j between each pair of nodes i and j such that Aij ^ (D. The 
multigraph of strongly connected components of G is the multigraph whose nodes 
are the strongly connected components of G, and which has a number of arcs 
between any two such components C and C' equal to the number of arcs i ^ j in 
G, with i £ C and j £ C' . We say that G is right (respectively left) locally finite 
if there are only finitely many arcs starting from (respectively ending at) each of 
its nodes. When G = G{A), we speak about strongly connected components of A 
instead of strongly connected components of G{A), etc. We say that A is irreducible 
when A has only one strongly connected component, that is, when G{A) is strongly 
connected. 

Rather than restricting our attention to eigenvectors, we will also consider the 
super- eigenvectors associated to a value A (or X- super- eigenvectors). These are 
vectors u € Mfj^xN I'D} such that Au < Xu, where < denotes the pointwise ordering 
of M^ax- The set of all vectors u £ K^ax satisfying Au = Xu (respectively Au < Xu) 
is called the X-eigenspace (respectively the X- super- eigenspace) of A. We shall say 
that u has full support when ^ (D for all i G S. Observe that if A is irreducible, 
then every super-eigenvector of A has full support. 

We define the maximal circuit mean of A to be 

Pi^) :=0(tr^')'/' Glmax , 

A:>1 

where tr A := ©^gs^M- Note that p{A) > (D when A is irreducible. The term 
"maximal circuit mean" can be justified by giving each path p through G{A) a 
weight \p\a ■= inp^v ^^'^ ^ length \p\ equal to the number of arcs of p. 

Then, 

(2) P{A):^ sup ^ 

c circuit of G{A) |C| 

(the division is in the usual algebra). The introduction of p{A) is motivated by the 
following result taken from |Dud92l Prop. 3.5]. We give a proof for completeness. 

Lemma 2.1. If there exists a X-super-eigenvector u with full support, then X > 
p{A). 

Proof. We have A'^u < X'^u and hence {A'')iiUi < X'^Ui for all i G S. Can- 
celling Ui and summing over i €1 S, we get tr A'' < X'^ . Taking the fcth root and 
summing over fc > 1, we get piA) < X. □ 

Given any matrix A £ Kma^f i define 

A+ := A® A^ ® A^ ® ■ ■■ € if^ax > and A* := I ® A+ , 

where / = A° denotes the max-plus identity matrix, that is the matrix with 1 on 
the diagonal and (D everywhere else. We have the following identities 

A+ = AA* = A* A, and A* = A* A* . 

The matrix A* is analogous to the potential kernel in ProbabiUstic Potential Theory. 
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It is possible that some entries of A* take the value +00. Indeed, if p{A) > 1, 
then A* = +00 for any i belonging to a circuit of weight greater than 1. The 
following proposition, however, gives sufficient conditions for A* to be finite. 

Proposition 2.2 (Finiteness condition for A*). Suppose that A G M^^^f is 
such that plyA) < 1 and the set of paths between any two distinct nodes of the 
multigraph of strongly connected components of A is finite. Then, the entries of A* 
do not take the value +00. This is the case in particular if A is irreducible. 

Proof. Since p{A) < 1, we have A*^ < 1 for all i e S. But A*^ = {A*A*)u > 
A*jA*^ for all i,j G 5", and so we get 1 > A*jA*^. When i and j are in the same 
strongly connected component, neither A*j nor A*^ equal (D. Therefore, neither of 
them can equal +00. 

Consider now two nodes i and j in distinct strongly connected components, 
and a path p from i to j, passing successively through the strongly connected 
components Ci, . . . , C^. We can write p as a concatenation p = piaip2 . . . ak-iPk, 
where for all 1 < to < fc, p„i is a (possibly empty) path from some node im S Cm 
to some node jm G Cm, and for all 1 < to < fc — 1, Um is the arc from jm to im+i- 
Of course, ii = i and jk = j. We have 

The assumption on the multigraph of strongly connected components means that 
(ii, ji, . . . , ik,jk) can only take finitely many values. Since all the A*^j^ are differ- 
ent from +00, we conclude that A*j, the supremum of \p\a over all paths from i to 
j, is different from +00. □ 

We will denote by A.i and Ai., respectively, the ith column and row of a matrix 

A. 

Proposition 2.3. For each A e M and i e S, the column u = (A^^A)* e Kmax 
satisfies Au < Xu. 

Proof. Consider B := X^^A. We have BB* = B+ < B* , and taking column 
i, we get BB*^ < B*. In other words Au < Xu. □ 

Remark 2.4. Combining Propositions 12.31 and 12.21 we see that when there 
are only finitely many paths between any two distinct nodes of the multigraph of 
strongly connected components of A, any column u ~ (A^^A)* , with +00 > A > 
p{A), is a super-eigenvector of A associated to the value A. 

3. Recurrent and critical nodes 

From now on, we assume that p{A) e M, and we introduce the normalized 
matrices 

Ax := X^^A for each A e R, and A . 

Definition 3.1 (Recurrence). A node i is recurrent if A^- = 1. We denote by 
N^{A) the set of recurrent nodes. We call recurrence classes of A the equivalence 
classes of N^{A) associated to the relation TZ defined by iTZj if Af-A^- = 1. 

This should be compared with the classical definition of recurrence for Markov 
chains, where a node is recurrent if one returns to it with probability one. Here, a 
node is recurrent if we can return to it with weight 1 in A. 
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The notion of recurrence extends the notion of critical graph occurring in the 
finite dimensional theory. Recall that the critical graph of A, denoted by ^{A), is 
the subgraph of G{A) obtained by taking the union of all circuits of G{A) attaining 
the maximum in The nodes of G'^{A) are called the critical nodes, the set of 
which we denote by N'^{A). The set of nodes of a strongly connected component of 
the critical graph is called a critical class. Obviously, critical nodes are recurrent 
and critical classes are contained within recurrence classes, with equality when S 
is finite. 

When S is infinite, A may have neither critical nodes nor recurrent nodes. Note 
that the definition of recurrence above is only useful when S is discrete. 

Example 3.2. Let 5 := N and take Ai^i+i := for all i e N, Ai^ := for 
all i e N \ {0}, and Aij := — oo elsewhere. The graph oi A is: 




where the nodes are numbered from left to right. Clearly, p{A) = 1. Although A 
has no critical circuits, it has a recurrence class, N, since Afj = 1 for all i,j G N. 

Example 3.3. Take the previous example, but now define Ai^ := —1 for all 
i G N \ {0}. The graph of A becomes: 



In this example, p{A) = 1 and A has no recurrence classes. 

Example 3.4. Take again Example 13.21 but replace the diagonal terms by 
An — for all z G N. The graph of A is now 



Now p{A) = 1 and A has an infinite number of critical classes consisting of the 
singletons {i} for i G N. Again, N is a recurrence class. 

4. Tightness and recurrence classes 

We now give a condition which ensures that the recurrence classes are the same 
as the critical classes. 

5 

We say that a vector v = {vj)j^s G l^maxj O'" ^ v : j t-^ vj from 5* to 
IRmax, is tight if for all j G S, Vj G Rmax, and if for all /? G M, the super-level set 
Jp := {j G 5 I Vj > f}} is finite. 

This is related to tightness of idempotent measures and capacities. Indeed, 
consider the idempotent measure with density v, defined by 

KviJ) supwj G K.,nax for all J C 5. 

Then, v is tight in the above sense if and only if Ky is finite and tight in the sense 
of |OV91L IAki95L |AQV981 lAkiflflL rPnhTTn , using the discrete topology on S. 
Tightness conditions also appear in fCKR84' Ch. 4]. 

We shall need the following elementary result, which is a special case of the 
fact that a function with compact super-level sets attains its maximum. 
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Lemma 4.1. If a map j f-^ Vj from S to Kmax is tight, then the supremum of 
Vj over j €z S is attained. □ 

We shall also use the following immediate observation. 

Observation 4.2. Let u and v he maps from S to Mmax and let a e R. If 
u < av and v is tight, then u is tight. □ 

Q y Q g 

Let A S Mjjjax • We say that a vector u ~ {uj)j(^s S I^max) or ^ map u : j ^ Uj 
from iS* to Mmax is A-tight if, for all i G S, the map j i-^ AijUj, from S to IR,„ax, is 
tight. 

Definition 4.3 (Property (T)). We say that a matrix A has Property (T) if 
all the columns of A* are A* -tight. 

The following observation shows that this assumption is symmetric between 
rows and columns. 

Observation 4.4. A matrix A has Property (T) if and only if, for all i,j e S, 
the map k > A*f,Alj, from S to Mmax, is tight. □ 

Proposition 4.5. // a matrix A has Property (T), then all the entries of A* 
belong to Mmax, and p{A) < 1. 

Proof. For all ij e S, A*j is equal to the supremum of A^f^A'^j over k S . 
By Observa,tion l4.4l Lemma lHl and the definition of a tight map, this supremum is 
attained and must necessarily belong to Mmax- As already observed before Propo- 
sition |01 this impHes that p{A) < 1. □ 

Lemma 4.6. Assume that A is irreducible. Then, the following three statements 
are equivalent: 

- A has Property (T); 

- for some j G S, the column A* is A* -tight; 

- for some i,j £ S, the map k ^ ^ik^lj' from S to Mmax, is tight. 
If these statements are true, then S is denumerable. 

Proof. Let £ S. Since A is irreducible, both A*^, and A*-,^ are strictly 

greater than (D. For all k e 5", we have A*f,A*j,^ > A*^,A*,j^A'^j,A*,j, and hence, 
^i'k^kj' ^ i^ii' ^j' ^ik^ky Using Observation 14.21 we deduce that the map 
k 1-^ A*,i.Alj, is tight whenever the map k i— > is tight. The required 

equivalences now follow from Observation 14.41 

Fix i e S" and, for each n S N, let J-„ := {k e S \ A*^.Al^ > -n}. Since A 
is irreducible, A*i^Al^ > (D for all k e S, and so S — UnsN ^ Property 

(T), then all the sets J_,i are finite, in which case, S will be denumerable. □ 

Lemma 4.7. Let i,j e S and /3 > ©, and let J := {fc e S* | A*f,Al. > /?}. Then, 

A^ <(3® {Ajj^ for alln>0 . 

Proof. Let p := [iq ~ i, . . . ,in = j) be a path from i to j of length n. If all 
the nodes of p are contained in J, then \p\a < {Ajj)^y If not, then one of the nodes 
iq, with < g < 71, is in S'\ J, in which case \p\a < ^?,,,^r~/ < 4*1,^*, j < ^ 
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Proposition 4.8. Assume that A has Property (T). Let i,j<ES and n gN be 
such that Af^ ^ (D. Then, there exists a path p := {io ~ . . . ,in = j) of length n 
from i to j such that 

A7j = \p\a := A:o»i • ■ • ^.„-i.„ ■ 
Moreover, if A'lj ^ (D, then there exists an elementary path p of nonzero length from 
i to j such that A^^ = \p\a- 

Proof. Fix i,j <E S and n e N. Choose f3 < Af^ and denote J := {fc G S* | 
A*^.Alj > /?}. Then, i,j £ J and, by Property (T), J is a finite set. By Lemma lTTI 
A^j < (3®{Ajj)fj. But, Af^ > 13 and A\) > {Ajj)^, so = {Ajj)^. Now, there 
are only a finite number of paths of length n from i to j that are contained entirely 
within J . Hence, the supremum of \p\a over the set of these paths is attained by 
some path p, and for this path (Ajj)^ = \p\a- 

Choose now /?' < A+. and let J := {k € S \ A*^Al. > f3'}. Again, i,j e J 
and J is finite. Applying Lemma, HTzl and taking the max-plus sum over n > 1, we 
obtain that A+ < /?' © {Ajj)±. This implies that A± = {Ajj)±. Now, any path p 
from i to j can be decomposed into a disjoint union of an elementary path po from 
i to j and elementary circuits. Since, by Proposition 14.51 p{A) < 1, we have that 
\p\a < \po\a- Hence {Ajj)^j is the supremum of \p\a over all elementary paths p of 
length \p\ > 1 from i to j in J. But since J is finite, there are only finitely many 
such paths and so the supremum is attained. □ 

Theorem 4.9. Assume that A has Property (T). Then N^iA) N''{A) and 
the critical classes coincide with the recurrence classes. Furthermore, the critical 
graph G"^(A) coincides with the graph G^{A) having set of nodes N^{A) and an arc 
whenever AijA'^- — 1. 

Proof. We may assume that p{A) = 1, so that A = A. Let us first prove 
that N^{A) = N'^{A). Recall that each critical node is recurrent, that is N'^{A) C 
N^{A). To prove the reverse inclusion, suppose i G S is recurrent, in which case 

= 1. By the second part of Proposition 14.81 there exists an elementary circuit 
containing i with weight 1. But piA) = 1, and so i is critical. 

Let i and j be nodes in the same recurrence class, so that A'^jA'^'^ ~ 1. Applying 
Proposition 14.81 again, we see that there exists an elementary path p from i to j 
such that Afj = \p\a and an elementary path p' from j to i such that = \p'\a- 
Concatenating these two paths, we obtain a critical circuit passing through both i 
and j. Hence, i and j are in the same critical class. This shows that each recurrence 
class is contained within a critical class. Since the converse inclusion is trivial, the 
recurrence and critical classes must coincide. 

Now, let {i, j) be an arc of G^{A), so that AijAj'^ = 1. Again, by Proposition l4.8l 
there exists an elementary path p from j to i such that A'^'^ = \p\a- Concatenating 
this path with the arc («, j), we obtain a critical circuit containing (i, j). Hence this 
arc is an arc of G'^{A). The converse, that each arc of the critical graph G'^{A) is 
an arc of G""(A), is trivial. □ 

None of the matrices in the three examples I3.2H3.4I have Property (T) . Never- 
theless, the conclusion of Theorem 14.91 is true for Example 31 

Example 4.10. Let S" N and take Ai^i+i := for all i G N, Aqo 0, 
Ai^i-i := —1 for alH e N \ {0}, and Aij := — oo elsewhere. The graph of A is 
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Obviously, A is irreducible and p{A) ~ 1. Calculating, we find that Afj takes the 
value j — i when i > j, the value —1 when z = j ^ 0, and the value otherwise. 
So, A has Property (T). We observe that A has a single critical class {0}, which of 
course is also the only recurrence class. 

Example 4.11. Let S" :== N and take Ai^^+i := for all i e N, := 
for alH € N \ {0}, and Aij -co elsewhere. The graph of A is 




Again, A is irreducible and p{A) ~ 1. This time = — J2k=j+i ^/^ when i > j, 
A'lj = — + 1) when i — j, and Aj- = otherwise. So this A also satisfies 
Property (T). However, now there are no critical classes and no recurrence classes. 

5. Eigenvectors associated to recurrent nodes 

The following proposition extends a well known result in the finite dimensional 
case. 

Proposition 5.1 (Recurrent columns of A* are eigenvectors). Let A e M 6e 
such that X > p{A). Then, the vector u (A^)* satisfies Xu = Au if and only if 
i is a recurrent node and X = p{A). In particular, if p{A) e R and there are only 
finitely many paths between any two distinct nodes of the multigraph of strongly 
connected components of A, then A* is a p{A)- eigenvector of A if and only if i is 
recurrent. 

Proof. We have A{Ax)* = X{Ax)^ ■ Observe that (Ax)* and {Ax)~^ coincide, 
except perhaps on the diagonal, where {Ax)*i = 1 ® (A^),^. But if i is recurrent 
and A = p{A), then (Aa),J = = 1, and so the ith columns of (Ax)* = A* and 
(Ax)^ = A+ coincide. In this case, 

AiAxn = p{A)A+ = p{A)A% = p{A){Ax)% . 

Conversely, if A{Ax)*i = A(Aa)* , then 

iAx)+^iAx{Ax)*,h^{Ax)*,^t . 

This implies that A = p{A) and i is recurrent. 

We now assume that there are only finitely many paths between any two distinct 
nodes of the multigraph of strongly connected components of A. The only additional 
thing to prove in this case is that u :— A* g R^3^x\{'D}- But this follows by applying 
Proposition 1221 to A. □ 

The following observation shows that eigenvectors corresponding to nodes in 
the same recurrence class are proportional. 

Proposition 5.2. Ifi and j belong to the same recurrence class, then 



A* — A* A* 
■i ~ -j ji 
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Proof. For i and j belonging to the same recurrence class, we have A'^-A^^ ~ 1, 
and thus A*jA*^ = 1. Using this and the fact that (A*)'^ — A*, we see that 

A* > A* A* > A* A* A* — A* 

for all keS. Therefore i^, ^ K^A*^ for all k<ES. □ 

Example 5.3. Let S" := N, p, g e Kmax and take A^^^+i := p for i € N, 
Ai^i-i := q for i € N \ {0}, and Aij := (D elsewhere. Consider first the case when 
neither p nor q are equal to C. Then, the graph of A is: 




We have p{A) ~ -^/M' ^^^^ is p{A) = {p + q)/2 in the usual algebra notation. Since 
A is irreducible, any eigenvector of A has full support. Lemma [2.11 tells us that 
any eigenvalue A must be greater than or equal to p{A). Since N is a critical class, 
therefore necessarily a recurrence class, Pronosition l5 . II shows that every column of 
A* is an eigenvector of A with eigenvalue p{A) and ProDosition l5. 21 shows that they 
are all proportional. We readily check that for any A > p(A), the vector u € 
defined by Uk (A/p)*^ (that is, Uk := k{X — p) in the usual algebra notation) is an 
eigenvector with eigenvalue A. So the spectrum of A, that is, the set of eigenvalues 
of A, is [p(^),+oo). 

Now consider the case when pq = (D. This time p{A) = (D and A is not irre- 
ducible. When p 7^ C and q = the vectors given by Uk := {\/pf;k G N are still 
eigenvectors, and so the spectrum of A is [0, +oo). When p = (D and 97^©, the 
spectrum of A is {©}. 

Since transposing A corresponds to exchanging p and q, we deduce that A and 
its transpose have the same spectrum when p 7^ (D and g ^ (D. 

Example 5.4. We now give an example to show that the spectrum of an 
irreducible matrix may differ from that of its transpose. 
Consider 5 = N and the matrix 



A = 





P 


P 


...\ 


p 


ai 


P 




(D 


P 






V: 









We assume that (D < /3 < 1, that (D < < 1 for all z G N, and that limi^oo cti = 1. 
Under these assumptions, p{A) = 1, A is irreducible, and the entries of A* = A* 
are finite. Observe that the maximal circuit mean p{A) is obtained by taking a 
loop at node i and letting i tend to +00. There are no critical nodes nor recurrent 
nodes. 

We claim that the spectrum of A is empty. Indeed, suppose u is an eigenvector 
with eigenvalue A. Then, u has full support since A is irreducible, and Lemma, l2?Tl 
gives that A > p{A) = 1. Setting p = X~^f3 and ^k = X~^ak, we rewrite the 
spectral equation Au ~ Xu as Ui = -fiUi © p{®j£n,j^i.j>i-i Since ji < 1, we 
see that 



(3) 



Ui=pi Uj) 

j€ti,j^t,j>i-l 
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Taking the sum of these equahties over i e N, and setting M ®jgN^j' '^^ S^^ 
that M = /iAf . Since /i < 1, this implies that either M ~ (D or M = +00. The case 
where M = (D can be eliminated, since u has at least one entry different from (D. The 
case where M = +00 can also be eliminated since Equation ijSl yields uq > ^M. It 
follows that the spectrum of A is empty. 

The transpose of A, on the other hand, has a non-empty spectrum: any A > 1 
is an eigenvalue and the corresponding eigenvector is (/^°, . . .). 

We conclude this section with two more properties of super-eigenvectors. The 
finite dimensional versions of these were instrumental in |ABG98l ICTGG99] . 

Proposition 5.5. If p{A) e M andv,w e Mj^ax ire super- eigenvectors of A 
associated to the value p{A), then the restrictions of v and w to any recurrence 
class of A are proportional. 

Proof. Let v be a super-eigenvector of A associated to p{A). Then Av < v, 
and so A*v < v. Fix a recurrence class C of A. For all i,j e C, we have Vi > 
^ij'^j > ^ij-^ji'^i ~ hence Vi = A*jVj. Therefore, the restriction of f to C 
is proportional to the restriction of A*j to C. Hence the restriction of any two 
super-eigenvectors v and w to C are proportional. □ 

The probabilistic analogue of the next result is related to the minimum princi- 
ple, as explained in |AGfl3[ Lemma 2.9 and Th. 3.4], in a slightly different context. 

Lemma 5.6. If p{A) e Rmax, Au < p{A)u and u £ K^ax) then {Au)i = p{A)ui 
for each recurrent node i. 

Proof. Assume that {Au).i < p{A)u.i for some i € S. Then, p{A) g M, u, ^ (D, 
and {Au)i < ap{A)ui for some a < 1. For all circuits (ii, . . . ,ik) in G{A) starting 
at ii = i, we have 

It follows that also different from (D. Combining the inequalities, we 

get that ^iii2 ■ ■ ■ ^ikii — Since this holds for all sequences (ii, . . . ,ik) such that 
ii — i, we get that Af- < a < 1, and so i is not recurrent. □ 

6. Representation of tight eigenvectors 

We show here that, when looking for A*-tight eigenvectors, the situation is 
similar to the case when S is finite. In particular, the eigenspace can be described 
in terms of the critical graph. 

Theorem 6.1. Lei A e R be such that A > p{A). If u e Mf-,^^ \ {0} is a 
{A\)* -tight X-eigenvector, then A = p{A), the set N'^{A) of critical nodes of A is 
non-empty, and 

(4) ■ 

Proof. We shall assume, without loss of generality, that A = 1, in which case 
Ax = A. Let M be a 1-eigenvector. Then, u = Au and so u = A*u. It follows that 

Ui > ^ij^j for all i e 5 . 

j£N-{A) 
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We now show the opposite inequahty when u is A* -tight. If = (D, this is trivial 
and so we assume the opposite. Since u is A*-tight, it is also A-tight. Therefore, by 
Lemma im for each j G S, there is some k G S such that Uj = Ajj.Uk. This allows 
us to construct a sequence {ik\k>i C S such that ii = i and Ui^. = Ai^i^^-^Ui^^-^ for 
all fc > 1. For this sequence, 

(5) Uii. = A^^i^^^ ■ ■ ■ Ai^^-^^^u.^^ for all 1 < ^ < /c . 

Suppose that all the ik are distinct. Then, the A*-tightness of u implies that, for 
each a € R, the set J := {j G S \ A*jUj > a} is finite. Now, some ik must be in 
S \ J. So, we may combine this property with J^l to get 

This holds for all a S R, and so Ui = (D, which contradicts a previous assumption. 
This shows that the ik can not be all distinct, in other words that ik+c — ik for some 
k,c> 1. From ^ with ^ = 1, we deduce that Ui^. 7^ (D. Using this and Equation Q 
again, we get that Ai^i^^^ ■ ■ ■ Ai^^^_^i^, = 1. This shows that p{A) > 1, and since we 
have assumed that p{A) < A = 1, we obtain that p{A) = 1. Moreover, ik G N'^{A). 
Using © again with £ = 1, we get 

Corollary 6.2. If there exists an A* -tight p{A)-eigenvector, then there exists 
an A* -tight critical column, that is, a column A*^, with j G N^{A). 

Proof. Let u be an yl*-tight eigenvector. By Theorem 16.11 we can find j S 
N''{A) such that uj ^ (D. Then A*^ < {uj)~^u and so, by Observation 1121 A*^ is 
necessarily >1* -tight. □ 

Corollary 6.3. // A is irreducible and there exists an A* -tight p{A)- 
eigenvector, then A has Property (T) . 

Proof. We apply Lemma IHH □ 

The set ^ of A*-tight vectors u such that Au = p{A)u is a subsemimodule of 
Mf;,axi meaning that ^ is stable under finite max-plus Hnear combinations. It has 
the following additional property: the least upper bound in R^ax of ^'^Y family of 
elements of ^ that is bounded above by an element of belongs to Subsets of 
I^max with the two properties above are said to be boundedly complete subsemimod- 
ules of Mfjax- See tLMSOl, LMS02, CGQO^ for general definitions concerning 
semimodules over idempotent semirings. 

Given a semimodule V over Rmax, one is naturally interested in representing 
the elements of V in terms of generators. We say that ^ G F \ {©} is an extremal 
generator of 1^ if f = u(B v with u,v G V implies that either ^ = u or ^ = v. This 
concept has, of course, an analogue in the usual algebra, where extremal generators 
are defined for cones. Max-plus extremal generators are also called join irreducible 
elements in the lattice literature. When is a boundedly complete subsemimodule 
of Rmax) we shall say that V is spanned by a family {£,'^}keK C F if any element 
vofV can be expressed as a (possibly infinite) max-plus linear combination of the 

in other words, has a representation v = ^keK ^feC^j where Vk G Rmax for each 
k G K. We say that a spanning family of V is minimal if it does not include any 
smaller spanning family of V . 
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Proposition 6.4. LetV be a houndedly complete subsemimodule o/M^^^, and 
let {^'^jfceif be a minimal spanning family ofV. Then, Sj' is an extremal generator 
of V for all k e K. 

Proof. Assume that {£,^}k<^K is a spanning family of V , but not necessarily 
minimal, and suppose it contains an element that is not an extremal generator 
of V . We may write = u ® v with both u and v mV different from Since 
{^^}k£K is a spanning family of V , there exist /i = {^k)k£K G ll^max v = 
{i^k)k&K e M^a,, such that u = ^^eK l^k^'' and v = ^k^^'^k^''- This implies for 
instance that > u> fii£,^ . Hence /i^^f < for all i e S, and since is different 
from (D, we deduce that < 1. If /i£ was equal to 1, we would have = w, a 
contradiction. Therefore, /i£ < 1, and similarly i^i < 1, hence ^i® ue, < 1. Since 
= uQv = ®keKit^k © and for all i € K, the maximum of {fik © Vk)^i 

over k e K cannot be attained at fc = / unless = C, we have the representation 

ii^k®,^k)e ■ 

keK\{e} 

Since can be expressed as a max-plus linear combination of {^'') kGK\{e} , this 
family must also be a spanning family of V. Thus the spanning family {^''}k£K is 
non-minimal. □ 

The following corollary of Theorem 16.11 extends a basic result of finite dimen- 
sional max-plus spectral theory [GM77> .CG79. |CDQV83| (see also |BCOQ92| 
Th. 3.100]). 

Theorem 6.5. Assume that A has Property (T). Let 3' be the semimodule of 
A* -tight vectors u G K^ax satisfying Au = p{A)u. Then, the extremal generators 
of are precisely the vectors of the form aA*^, where a € R and j is a critical 
node. Moreover, we may obtain a minimal spanning family of 3" by taking exactly 
one column A*^ from each critical class of A. 

Proof. Again we can assume, without loss of generality, that p{A) = 1, and 
so A = A. By Theorem HjI N'^iA) = iV'^(A). If there are no critical nodes, then 
by Theorem 16. II 3 = {©}, which is spanned by the empty set. So we shall assume 
that N'^{A) 7^ 0. Denote by J some subset of N'^{A) obtained by taking exactly 
one element from each critical class of A. Any A*j with j £ J is a p(A)-eigenvector 
by Proposition 15. 11 and is A* -tight since A has Property (T). Thus A*^ € £^ for all 

je J. 

By Pronosition l5.2l all the A*j with j in the same critical class are proportional. 
So, the representation of u e given by Theorem 16.11 can be reduced to u 
0jgj A*jVj, where Vj e Mmax for all j & J- We may rule out that lyj = +oo for any 
j £ J since this would lead to u having a component -t-oo (by Uj > A*jVj = Vj) 
which is impossible since 17 C Kmax- This shows that 3^ is spanned by the family 

We now show that this family is minimal. Suppose, for some i G J, A*^ ~ 
0jgj\{i} i^j^*,-- Then, A*^ > VjA*^ = for all j £ J \ {i}. So the vector ly is 
A* -tight, if we define i^k C for all k ^ J \ {i}. Hence, by Lemma ^Jl for all 
k G S, the supremum in Al^ = 0jgjy{ii, '^j^lj is attained by some j G J\{i}, that 
is = i^j^lj- Applying this to fc = i, we get 1 = A*^ = VjA*^. Since Vj < A*^, 
we obtain 1 < A*^A*j < 1. Hence, i and j are in the same recurrence class, and 
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SO by Theorem l4.9l they are in the same critical class, a contradiction. The second 
statement of the theorem follows. 

We deduce from the second statement of the theorem and from Proposition 1^31 
that any vector proportional to some A*j, where j is critical, is an extremal genera- 
tor of 5^. It remains to check that all the extremal generators of ^ are obtained in 
this way. So, suppose there existed an extremal generator uoi ^ which was not pro- 
portional to any of these A*^. For any k £ N'''{A), we may write the representation 
given in Theorem Ifi.ll in the form u = UkA*f. ffi v, where v = ^j^N^iA^Xik} 
Since u is extremal and not proportional to A*i,, we must have u ^ v. More gener- 
ally, we may write 

(6) ".-4* , 

jeN'=iA)\K 

for any finite subset K of N'^{A). Consider now any i £ S and e M, and let 
K := {j e N'^(A) I A*jUj > /?}. Since u is ^*-tight, the set K is finite, and we 
deduce from © that Ui < /3. Since this holds for all i & S and /3 S M, it follows 
that M = (D, which contradicts the assumption that it is an extremal generator of 
3^. □ 

We shall see in Section |H| that if A does not have Property (T) , then the set 
of /9(^)-eigenvectors of A may or may not be spanned by the critical columns of 
A*. We shall also see that, even when A has Property (T), there may exist p{A)- 
eigenvectors that cannot be represented in the form Q. These, of course, are not 
A* -tight. 



7. Cyclicity theorem 

In this section, we investigate the powers of matrices having Property (T). Our 
first result is a max-plus analogue of the fact that the powers of a transient Markov 
matrix converge to zero. 

Theorem 7.1. Assume A has Property (T), and that either p{A) < 1 or 
N'^iA) = 0. Then, for all i,j eS, 

lim A" = (D . 

Proof. Let us fix ij e S and /3 > (D, and let J -.^ {k e S \ A*^Alj > f3}. 
Since A has Property (T), J is a finite set. By Proposition 14.51 p{A) < 1. Since 
either p{A) < 1 or N'^{A) is empty, all circuits have a weight strictly less than 1. 
Since J is finite, we conclude that p{Ajj) < 1. This implies that {Ajj)2j converges 
to (D as n ^ oo. Indeed, for any matrix B e K^lx either p{B) = (D, and then i?" = (D 
for all n > d (because any path of length at least d in the graph of B must contain 
a circuit), or (D < p{B), and then, B* exists and is finite, and i?" < p{By^B* for 
all n > 0. Taking B = Ajj, we use Lemma HTzl to deduce that Afj < (3 for n large 
enough, and the result follows since /3 is arbitrary. □ 

Remark 7.2. The convergence of A^^ to (D may be arbitrary slow. For instance 
the matrix A of Example 14. 1 II satisfies the assumptions of Theorem l7.lL and Aqq = 
— i ^ ~ ^ogn, which goes to (D in a sublinear way. 
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Definition 7.3 (Cyclicity). The cyclicity jiG) of a strongly connected (pos- 
sibly infinite) graph G is defined to be the gcd of the lengths of its circuits. The 
cyclicity of a non strongly connected graph is defined to be the 1cm of the cyclicities 
of its strongly connected components. 

For a matrix A G Kf^ax j denote by J (A) the cycHcity of its graph G{A) and 
by (j{A) the cycHcity of its critical graph G'^{A). 

Note that 7(G) may be infinite when G has an infinite number of strongly 
connected components. If there are no strongly connected components, then 7(G) 
is equal to 1 (by convention, the 1cm of an empty set is 1). We write a = b[c] when 
a — 6 is a multiple of c. 

Theorem 7.4 (Cyclicity theorem). Assume that A is irreducible, that A has 
Property (T), and that N^iA) ^ 0. Then, for all i,j G S, there exist a^j £ N \ {0} 
and Uij G N such that, 

(7) A^^^^ ^piA)^^^A^ forn>n,, , 
and we have the following explicit formula 

(8) (i'(i"-)*).fc(i''(i"'0*)fe.- , forn>n,,, 

where q,q' are arbitrary numbers in {0, . . . , (7^ — 1} such that q + q' = n[aij]. 
Furthermore, when a{A) is finite, the integer aij can be chosen so that it divides 
a{A). 

The special case of this result when the state space S is finite was estabHshed 
in |CDQV83| . The book |BCOQ92| contains (Theorems 3.112 and 3.109) a par- 
tial account of the results of that paper and is perhaps more easily available. 

The integers are sometimes called coupling times. As we discuss in Re- 
ma,rk l7.lIl below. our proof of Theorem [Ol yields expHcit estimates of the coupHng 
times, and of the integers dij. It also shows that every long optimal path must pass 
through a critical node. In fact, the following theorem shows that optimal paths 
stay most of the time in the critical graph. 

Theorem 7.5 (Turnpike theorem). Make the same assumptions as in Theo- 
rem \7.4\ Then, for all i,j £ S, there exists rriij G N having the following property: 
any path from i to j having maximal weight amongst all paths with the same ends 
and length, has at most rriij non-critical nodes. 

The name "turnpike theorem" refers to a general class of results in dynamic 
programming, see for instance |KM97I Section 2.4]. 

To prove the cyclicity and turnpike theorems, we need a series of auxihary 
results. 

Lemma 7.6. Assume that p{A) = 1. Let i,j G S and /3 > 0, and write 
J := {k £ S \ A*f^Al^ > P}. If k £ J r\ N''{A), then the recurrence class of k 
is included in J . In particular, if k £ J C\ N'^{A), then the critical class of k is 
included in J . 

Proof. Let G be a recurrence class of A, and fc G J n G. Then, ^^^^1^ = 1 
for all £ £ C. Hence, 

4* 4* > 4* 4* 4* 4* — A* A* > R 
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for all £ € C, which shows that C C J. This yields the first assertion of the lemma. 
Since critical classes are contained within recurrence classes, the last assertion fol- 
lows. □ 

Corollary 7.7. If A has Property (T), then all the critical classes of A are 
finite. 

Proof. Let C be a critical class of A. Replace A by A and take i = j = k e C 
and (3 = 1 in Lemma, FTfil Since i E J, we get that C C J. By Property (T), J is 
finite, hence C is finite. □ 

We shall need the following standard result of Perron-Frobenius theory. 

Lemma 7.8. Let G be a (possibly infinite) strongly connected graph and denote 
by ^ G N\{0} its cyclicity. Then, for all nodes i and j ofG, there exists Vij G N\{0} 
such that: 

- all paths p from i to j in G satisfy \p\ = Vij [7], 

- for all n = Vij [7] such that n > vtj, there exists a path in G from i to j 
of length n. 

This lemma was proved in |BR.91[ Lemma 3.4.1 and 3.4.3] when G is finite, but 
the proof there also works when G is infinite. Similar results were given in |KSK66l 
Ch. 6,§ 3] in the context of denumerable Markov chains. 

For any nodes i and j of a graph G, the least Vij satisfying the assertions of 
Lemma FTsI will be denoted by i'ij{G). The problem of computing i'ij[G) has been 
much studied in Perron-Frobenius theory, where the maximum of Vij{G) over all 
i,j is sometimes called the exponent of G. It is known that when 7=1 and G 
is finite, Vij{G) < (|G| — 1)^ -I- 1, where \G\ denotes the number of nodes of G; 
see |BR91I Th. 3.5.6]. For an irreducible matrix A, we simply write i^ij{A) instead 
ofi.„(G(A)). 

For any matrices A and integers s, q such that < s < g, we define t-j''{A) to 
be the length of the shortest path p from i to j satisfying |p| = s [q] and \p\a = 
{A'^ (A'^)*)ij . By convention, T^j'^{A) = +00 when no such path exists. The following 
lemma gives a sufficient condition for the existence of such a path. 

Lemma 7.9. Assume that A has Property (T). Then, for all i,j(zS and < 
s < q such that {A'^ {A'')*)ij ^ (D, there is a path p from i to j such that \p\ = s [q] 
and \p\a = {A'{A'J)*),j. 

Proof. Consider the vector v such that Vk = A''^^{A'^)lj. Since Vk < A*^Alj, 
Observations 14.21 and 14.41 show that v is tight. By Lemma ITTl {A" {A'^)*)ij = 
Aifc(A')fcj fo'" some k e S. By Proposition 14.81 A^f, = \p\a for some path p from i 
to k in the graph of A. Now < A*, and so A'^ also has Property (T). Using 

ProDosition l4.8l again, we get that {A'^)^j = \p'\a<i for some some path p' from k to 
j in the graph of A"^. Using Proposition 14.81 a third time, \p'\ai = \p"\a for some 
path p" from k to j in the graph of A whose length is a multiple of q. The result 
follows. □ 

When G{A) is finite, we have the following explicit bound: t^-'^{A) < s + 
q{\G{A)\ - 1), provided that e R. 

For each critical node k of A, we denote by cr(fc) the cyclicity of the strongly 
connected component of k in G'^{A). Observe that cr(fc) divides <t{A) and, if A is 
irreducible, is a multiple of j{A). 
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The following technical lemma provides a lower bound on the ultimate values 
of Afj as n tends to infinity. It will follow that any sufficiently long optimal path 
must remain within the finite set J defined in the lemma. This will allow us to 
control the asymptotic behavior of Afj in essentially the same maner as in the finite 
dimensional case. 

Lemma 7.10. Let A be as in Theorem \7.4l and assume furthermore that p{A) = 
1. Let 7 :— j{A) be the cyclicity of G{A). Let i,i £ S and t <E {0, ... ,7 — 1} be 
such that t = Vij (A) [7] . Then, we can find at least one critical node I such that 

Pi, min ^ J) . 

Choose such an I arbitrarily, take any number (D < /3y < (3^j, define J :~ {k £ S \ 
A*kA*f.j > f3ij}, Uij := 1cm {cr(fc) | k € N''{A)r\J}, and, for each r G {0, . . . , CTy-l}, 
define 

(9) Qh--= {A\A^^'yU{A^\A"^^y)u, . 

keN^iA) s,s'e{0,...,(7ij-l} 
s+s'=r [atj] 

Then, 

(10) Qij > (3ij when r = Viji^A) [7], and Q^j = (D otherwise. 

Proof. Take any critical node k. Since A is irreducible, there exists a path pi 
from k to j in G{A). Let to G {0, . . . ,cr{k) — 1} be such that to + |pi| = [cr(fc)]. 
Let c be a critical circuit passing through k. Then, |c| > 1 and by definition, cr{k) 
divides |c|. Moreover, there exists £ in the same strongly connected component as 
k in N''{A), such that c can be written as the concatenation of a path p2 from 
A; to of length |c| — to and a path ps from ^ to fc of length to. Hence, P3P1 is 
a path from £ to j of length to + = [o'(fc)]. Since (t{1) ~ a-{k), this implies 
that (A'^(^))^^. 7^ (D. By Lemma EHl for all 71 > u^iA) such that n = va{A) [7], 
Al ^ ©. Hence, lit' = [7], mini<„<,(,)/^(A*'+«^(A-W)*),f (A^W),*^. ^ © 

(since 7 divides cr[£))- Then, necessarily t' = VijiA) [7] (otherwise the above term 
is (D), which shows that Pfj 7^ (D. 

Since A has Property (T), the set J is finite. By Lemma FTfil J contains any 
critical class that it intersects. Since the critical node £ belongs to J, we conclude 
that piAjj) = 1 and 7V=(A) n J = N^iAjj). Therefore cr^ = ct{Ajj). Moreover, 
7 divides aij . 

Fix r € {0, . . . , aij — 1}. By definition, Qlj is the supremum of all the weights 
\p\a of paths p from i to j of length \p\ = r[aij] that pass through N'^{A). In 
particular, Ql^ = (D for all r ^ i^ijiA) [7]. Assume now that r = Vij{A) [7]. Since 
£ € N'^{A) n J, a{£) divides aij, and we can choose u G {1, . . . , cr{£)/j} such that 
t+u-f = r[a{£)]. Therefore ftj < (A*+"t(A'^W)*),^(A'^W)*^.. Bv LemmaFHH we can 
find a path p from i to £ with \p\ = t + u-y [(t{£)], such that (A*+"T(A'^W)*)i^ = |pU, 
and we can find a path p' from £ to j, with |p'| = [cr(^)], such that (A'^(^^)|^ = \p'\a- 
Then, (3ij < \p\a\p'\a- By Lemma, FTsl for any multiple n of o-(€) that is large 
enough, there exists a path p" in G'^{A) from £ to € of length n. The weight \p"\a of 
this path is 0. Since a{£) divides aij , we can choose n such that |p| +n+ = r [aij]. 
Concatenating p, p" and p' we get a path p'" from i to j of length = r \aij\ 
passing through 7V^(A). Thus A, < bUb"Ub'U = \v"'\a < Qly □ 
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Lemma 7.11. Let A, 7, i, j, (3ij, J, Uij, r, and Q\j he as in Lemma \7.1fA 
Denote J' := J\ N'^{A) and B := Ajiji, and define 

{0 if either i ^ J' or j ^ J' , 

\J'\ ifp{B)^Q andi,jeJ' , 

min{m S N | p{B)"'B*^ < Q[^.} otherwise. 

Denote by Nl^ the set of triples {k,s,s') which attain the maximum in (jH)), and 
define 

(12) := min rli^'^^ {A) + a,,uuk{G'^{A''^^)) + t(:''^' {A) . 

{k,s,s')eN[j 

Then A'^j = Ql^ for all n > n^j such that n = r [cy], where n^j max(/i^j-, 

Proof. If r ^ i^ijiA) [7], then, by LemmaE!H|and Equation lHHJ, Qlj = A'^j = 
(D for all n = r [a.ij]. So we assume that r = Vij{A) [7]. 

Let us first show that A"^ < Q\,^ for all n = r [aij] such that n > . We saw 
in the proof of Lemma EHH that piAjj) = 1 and N^iA) n J = N^iAjj). Hence 
p{B) < 1. Let n = r[aij]. By Lemma ^3 there exists a path p from i to j of 
length n such that A^j = \p\a. If P intersects N'^{A), then, by definition of Qlj, 
\p\a < Qij- If P intersects S\J, then, by definition of J, \p\a < Pij- But (3ij < Qlj, 
by Lemma f7. 101 and therefore, \p\a < Qij- Otherwise, p is included in J', which 
implies that i,j g J' and < B"j. This shows that for all n = r [dij], 

< © if z, j e J' and < otherwise. 

Since Q^j ^ (D, the integer [i\j defined by Ijllll exists. Applying again the observation 
of the proof of Theorem EH we get that = (D for all n > | J'|, if p[B) = (D, and 

< p{BYB* for all n > 0, if p{B) > (D. Hence, by definition of fi^^, we have 
A^j < Qij for all n > /i^^- such that n = r [aij]. 

We now show that the reverse inequality holds for all n = r[aij] such that 
n > i^lj. Since (A*(A"-)*)^fc(^''(^"'0*)fcj < ^*fe^fcj, and since Q'^- > A, ^ C, the 
set Nlj is included in J x {0, . . . , fXy — 1}^, and Lemma, HaI shows that A^^^ ^ 0. 
This impHes that the integer I'lj defined by lfT2|l exists. Moreover, = r[(Ty]. 
Let (fc,s,s') G Nlj be a triple attaining the minimum in II12|I . By Lemma f?. 91 we 
can find a path p from i to fc of length T^j^''' {A) such that [A'^{A'^^^ )*)ik ~ \p\a, 
and a path p' from k to j of length t^^''^'^^) such that {A^ {A'^'^)*)kj = \p'\a- 
Since cr(fc) divides cry , then p{A'^'^) = 1, and since to every path of length naij 
in G'^{A) corresponds a path of length n in G"^(A'^'j ), it follows from Lemma [7.81 
that the cyclicity of the strongly connected component of k in G^{A"''^) is equal to 
1. Applying Lemma [7.81 again, we get that for each n > h'kkiG'^{A°''^)), there is a 
path p" in G''{A'^'^) from fc to fc of length n. To this path corresponds a path p'" 
in G''{A) of length ncr-y, with the same ends. We have \p"'\a = 1- Concatenating 
p, p'" and p' we get a path from i to j of length \p\ + nuij + \p'\ = r [cr.y] such 

that Qij = \p\a\p"'\a\p'\a < 4^'"^""'^"^'^''. We deduce that for all n > ulj such 
that n = r [o-y ], Q^j < Afj. Then, for all n > ma.x{i^ij , p^j) such that n = r [cry ]. 
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Lemma 7.12. Let A, i, j, Uij, r, and he as in Lemma \7.1f\ For all 
g, e {0, . . . , (Jij — 1} such that q + q' = r [cTy ], we have 

(13) Ql^= ■ 

Proof. We denote by Pij the right hand side of ljl^^|l . and write 7 instead 
of j{A), as before. Trivially, < Q^j, hence, by ifTH)! . = = (D when 
r ^ i^ij(A) [7]. So we assume that r = [7]. Choose (fc,s,s') in the set 

Nlj defined in the proof of Lemma [7.111 Take also p,p',p"' as in the same proof, 
with \p'"\ = a.jVkkiG^A'''^)). We have Q^^ = \p\a\p"'\a\p'\a. Moreover, for all 
m S {0, . . . , and in particular, for < to < o-y, there exists £ in N'^{A) such 

that p'" can be written as the concatenation of a path pi from fc to £ of length m and 
a path p2 from £ to A: of length \p"'\ — to. The concatenated path ppi goes from i to 
£ and has length |p| + to = s + m [cry] . The concatenated path p2p' goes from £ to j 
and has length — to+|p'| = —m+s' [o-y]. Choose to such that s + m = q [aij], so 
that -m + s' = q' [cTy]. Then, \ppi\a < {Ai{A''^')*)u and \p2p'\a < {A^' {A'''^)*)ej . 
This shows that Q^^ = \p\a\p"'\a\p'\a = \ppi\a\P2P'\a < P^J. □ 

Proof of Theorem 17.41 We can assume without loss of generality that 
p{A) ~ 1, so that A. We obtain Equation jHJ from Lemmas [7. 1 II and f7. 121 bv 
taking cry as in Lemma [7 . 1 01 and 

Uij := max n'',- . 

0<r<aij-l ■' 

Equation Q follows immediately. □ 

Proof of Theorem 17.51 We assume again, without loss of generality, that 
p{A) = 1, so that A = A. Let n > 1 and let pi be a path of length n from i to j that 
has maximal weight amongst all such paths, that is, \pi\a = A"^ > (D. Let aij and 
riij be defined as in Theorem 17.41 Let f3ij and J be defined as in Lemma lV.lOl and, 
for r S {0, . . . , aij — 1}, with r = n [aij], let Qij be defined as in Lemma, [7.101 By 
Theorem 17.41 Lemma 17.121 and Lemma 17.101 we have = Q^^ > (3ij if n > . 
So, all the nodes of pi must belong to J. For each path p in J, let ||p|j denote 
the number of arcs of p whose initial node is non-critical. In particular, when p 
is a circuit, ||p|| = if and only if all the nodes of p are critical. Let 1? denote 
the maximal value of the mean weight IclY"'^" over all elementary circuits c that 
stay within J and contain at least one non-critical node. Since J is finite, ■(? < 1. 
We next show that, when n > riij, the number of non-critical nodes of pi can be 
bounded by a constant Write pi as a disjoint union of an elementary path 
Po from i to j and of elementary circuits ci , . . . , Cs . First consider the case where 
?? = 0. Then, all the circuits that stay in J are critical, and so the number of 
non-critical nodes of pi is at most equal to the number of nodes of po, which is at 
most equal to the number of nodes of J, since po is elementary. Thus, in this case, 
we can take K^j := \J\. Suppose now that 7^ C. Since the weight of any circuit 
contained in J is at most 'i?"'^'!, we have 

A?, = \pi\a < boUi?ll^^"+-+"^-'" = bol^^ll^^ll-ll^"" < C,,^?llfill , 

where dj is equal to the maximum of the quantity |po|y!ii?~"^o" over all the el- 
ementary paths p'q from i to j that stay in J. Since the number of non-critical 
nodes of pi is at most + 1, we can take k^- to be the least integer such that 
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Cij-d^'^ < Qly Then, the number of non-critical nodes of pi is bounded above by 

rrii-j maXrg{o,...,o-,j-i} max(ny , □ 



Remark 7.13. The quantities d and Cij which appears in the proof of Theo- 
rem can be computed by max-plus Schur complement formulas, see |ABOfl4l 
Section 4]. 

Remark 7.14. The proof of Theorem 17.41 yields an explicit estimate of the 
integers cry and the coupHng times n.y , appearing in Theorem 17.41 The bound on 
the coupling time involves an essentially "arithmetical" term, j/f^ (depending on the 
constants Vkk), and the maximal circuit mean p{B) of a certain submatrix B oi A 
(see Lemma E^}. In the case when S is finite, the problem of estimating has 
received attention. In this special case, the bound of the present paper improves 
the bound of |BG01| . which uses related ideas. A bound of a different nature has 
appeared in |HA99| . 

Remark 7.15. The bound of rty depends on the choice of the critical node 
£ in Lemma r7.1fll Choosing the critical node I which maximizes the quantity /Jf^- 
defined in Lemma IV. 101 vields the smallest set J, and therefore, the best constants 
aij and n^. When S is finite, the technicalities of Lemma l7. 101 might be dispensed 
with, at the price of a coarser bound. We may just take Pij ~ (D and J := 5 in 
Lemma [V.lfll and Lemma IV. Ill to compute Uij and Uij. 

Remark 7.16. Example 13 . 81 shows that Property (T) cannot be dispensed with 
in TheoremO In this example, p{A) = 1 and N''{A) = iV(A) = 0, but A^q does 
not tend to (D as n tends to infinity. 

Without Property (T), one would not expect convergence in finite time to a 
periodic regime as in Theorem 17.41 The following counter-example shows that one 
might not even have asymptotic convergence. 

Example 7.17. We will give an irreducible matrix A with the following fea- 
tures: A does not have Property (T), N''{A) = N''{A) ^ 0, p[A) = 1, the sequence 
(A"i)„>2 is bounded but there is no positive integer cr such that A^^ converges as 
n tends to infinity. Let 5 := N, and let a2, as, . . . denote any sequence of negative 
numbers. We set Aqo '■— 0, Aqi = Aio := —1, := and A^+i i ai+i for 

i>\. All other arcs are given weight — oo. The graph of A is 



If otn > —2 and Q;„+p > an + ap for all n,p > 2, then A"^ — q;„ for n > 2. 
Choosing for 012, aa, . . . any sequence taking only the values —1 and —2 and having 
arbitrarily many consecutive occurences of each, we get the announced property for 
the sequence A^^. 

8. Representation of Max-Plus Eigenvectors and Max-Plus Martin 



In this section, we present, without proof, some of the results of |AGW04| . 
and show how they relate to some of the examples we have encountered. The focus 
of attention in that paper was the 1-eigenspace. By analogy with potential theory, 
the elements of this eigenspace were called harmonic vectors and elements of the 




Boundary 
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1-super-eigenspace were called super-harmonic vectors. Here, we restate the results 
in terms of a general A-eigenspace, a trivial change since this eigenspace is exactly 
the set of harmonic vectors with respect to A\ := X~^A. 
We shall make the following assumption. 

Assumption 8.1. There exists a row X- super- eigenvector with full support, that 
is a row vector n E M.^ such that Att > ttA. 

This assumption implies, in particular, that p{A) < A (see Lemma . that 
TT = Tr{Ax)*, and that (Aa)*, S M,nax for all ij € S. 

We shall look for eigenvectors u that are n-integrable, meaning that nu < +00. 
We denote by (Sa the boundedly complete subsemimodule of K,^ax consisting of 
those TT-integrable vectors u such that Au = Xu. 

It is often possible to choose tt := {A\)l, for some b E S, for instance when 
A is irreducible. With this choice, every A-eigenvector u S K^ax is automatically 
TT-integrable. 

We define the Martin kernel K with respect to tt and A: 

K,, := {Ax)*j{^j)-^ for all 1,3 eS . 

Since TTi{A\)*j < {n{A\)*)j = ttj, we have 

Kij < {TTiy-^ for all i,j G S . 

This shows that the columns K.j are bounded above independently of j. By Ty- 
chonoff's theorem, the set of columns — {K.j \ j E S} is relatively compact in 
the product topology of R^iax- The Martin space is defined to be the closure of 
in this space. We call := the Martin boundary. 

Let u £ Rn-iHK be a 7r-integrable vector. We define the map yU„ : ^ Kmax by 

fJ'uiw) := limsupTTjUj :— inf sup TTjUj for w G , 

where the infimum is taken over all open neighborhoods of w in The map 
jjLu is automatically upper semicontinuous and bounded above by nu < +co. 

We wish to define a particular subset of the Martin space, called the minimal 
Martin space. To do this, we introduce a kernel over ^ which extends, in some 
sense, the (^a)^ matrix: 

H^{w',w) := limsup liminf 7ri(^A)iw(7rj)^^ . 

K.i^w' K.j-tw 

Note that 

H\w',w) < 1 for all w,w' G . 

When i, j G S, 

We now define the minimal Martin space to be 

:= {we.^\ H\w, w)=1} . 

Theorem 8.2 (Poisson-Martin representation, |AGWn4] l. Any element u G 
(OA can be written as 

(14) u = ^ iy{w)w , 
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with V : Kinax, and necessarily, 

(15) sup iy{w) < +00 . 

Conversely, any v : ^™ Kmax satisfying II15|) defines by il4\i an element u of 
S'\. Moreover, given u <=i Sx, /i„ is the maximal v satisfying Ijl4|) . 

This theorem shows, in particular, that S\ = {0} if and only if ^™ is empty. 

We say that a vector u e Kmax is normalized if Trit = 1. If a subsemimodule of 
Mfjax contains only 7r-integrable vectors, then its extremal generators are exactly 
those vectors of the form a^, with a € R and ^ a normalized extremal generator. 

Theorem 8.3 f |AOWfl4] l. The normalized extremal generators of S\ are 'pre- 
cisely the elements of . 

Remark 8.4. Suppose A = /9(A), there are only finitely many recurrence 
classes, and all but finitely many nodes are recurrent. In this case, is a fi- 
nite set, and so ^ = ,yif , the boundary is empty, and ^™ is the set of columns 
K.j, with j recurrent. Then, the representation theorem ('Theorem l8.2|l shows that 
any p(^)-eigenvector is a finite Hnear combination of the recurrent columns of A* , 
just as in the finite dimensional case. We saw an example of this situation in 
Examples 13.21 and 13.41 There S" = N was the only recurrence class, and so any 
1-eigenvector had to be a multiple of A*^ = 1, and hence constant. 

In |AGWn4| . we also prove a representation theorem for super-eigenvectors 
similar to Theorem l8.2l with replaced by . Moreover, we characterize 

^™ U ^ as the set of normalized extremal generators of the set of 7r-integrable 
vectors satisfying Au < Xu. 

The following result gives a condition which guarantees the existence of eigen- 
vectors. 

Proposition 8.5 f |AGW04] l. Assume that S is infinite, that the vector 
Tr~^ := ii'n'i)~^)ies is A-tight and that (D ^ Then, is non-empty. 

Corollary 8.6 f |AGW04| l. A ssume that S is infinite, and that A is irre- 
ducible and right locally finite. Then the spectrum of A is [p(^), +00). 

Example 8.7. The matrix A of Example 15.31 with p, g 7^ (D, satisfies the as- 
sumptions of Corollarv l8.fi[ and so its spectrum is [p[A), +co), as we have already 
noted. Let us compute the A-eigenspace of A for A > p{A) = ^Jpq- We take 
TT := (Aa)5.. Clearly, tTj = (p/A)^ for all j G N. Also, A'y = (A/p)' when i < j 
and Kij = {X/py(j}q/X'^y~^ otherwise. Hence, ^™ =■ SS = {u}, where the vector 
u g is given by Ui := [X/pY for all i G N. So, Theorem 18.21 shows that every 
A-eigenvector is a multiple of u. 

Example 8.8. The matrix A of Examnle 15.41 is irreducible and left locally 
finite, so Corollary 18.61 shows that the transpose of A has an eigenvector for all 
A > p{A) . However, A has no eigenvectors, which shows that the assumption that 
A is right locally finite is needed in Corollarv 18.61 One can also prove that A has 
no eigenvectors, using Theorem 18.21 Indeed, let A > 1 and consider tt := {A\)^.. 
We have ttq = and -Ki = (3 — \ when i > 1. Therefore, tt"^ is not A-tight, and so 
does not satisfy the conditions of Pronosition 18.51 We have Kij = when i < j, 
Kij = {f3 — X){i — j — 1) when i > j > I and Kij = [(3 — X)i otherwise. Hence, 
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SS = {1}, where 1 is the unit vector. Since A has no recurrent nodes, C 
and since 1 is not an eigenvector of A, we deduce that is empty. Theorem 18. 21 
then shows that, for all A > there is no A-eigenvector. 

Remark 8.9. In general, the p(A)-eigenspace S oi A may or may not be 
spanned by the critical columns of A* . Let us first consider examples of matrices 
A such that A does not have Property (T) . It follows from Remark 18.41 that for 
the matrix A of Example 13.21 S is the set spanned by the unit vector (the vector 
identically equal to 1), whereas the graph of A has no critical nodes. When A is the 
matrix of Examnle 13.41 S is again spanned by the unit vector, all the columns of 
A* are critical, and coincide with the unit vector, and critical classes are singletons, 
so that picking one column A*^ per critical class of A, as in Theorem 16.51 yields a 
non minimal spanning family of S . 

Let us now consider examples of matrices A such that A has Property (T). 
Even in this case, there may exist p(yl)-eigenvectors that do not have the represen- 
tation l(3l. For example, the matrix in Example 14 . 1 II has no critical classes, whereas 
one can show that it has p(A)-eigenvectors. Indeed, take tt = Aq. = 1. Observing 
that Kij = A*j — > 1 when j goes to infinity, we see that the boundary consists 
of just the unit vector 1. Since A has no recurrence classes, ^™ C 3§, and since 
1 is an eigenvector, the minimal boundary is given by ^™ = ^ {1}. Thus by 
Theorem 18. 21 every p(A)-eigenvector is constant. 

To take another example, the matrix in Examnle 14 . 1 01 has a single critical class 
{0}. The associated eigenvector A*q = (— i)iGN is A*-tight. But, taking tt = Aq. = 1 
as before, we again get that SS = {1}. Then, = {A%, 1} and by Theorem lO 
any 1-eigenvector is a max-plus linear combination of A*^ and 1. 
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